1 link tagged with all of: hermes + andrew chen + framework desktop
Click any tag below to further narrow down your results
Links
@andrewchen on X
Andrew Chen lays out his homelab for running AI models locally, built around a Framework Desktop, an RTX 5090 eGPU, and two DGX Sparks. He routes most requests to local models through a small router model, aiming for 100% local use, and admits the setup is overbuilt and regrets the eGPU.
- A Qwen 3.8 27B model on a 5090 eGPU hits 150+ tokens per second, making it the fast local option.
- Two DGX Sparks running DeepSeek V4 Flash handle slower batch work like cron jobs and long dev builds.
- A homegrown Hermes plugin uses a small Arch-Router model to decide between local and cloud, currently keeping about 60-70% of work local.